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INTRODUCTION 
A. Background 


This report provides a-statistical summary of the data submitted 
by local school districts in Massachusetts on their ''198]-82 Annual Report 
on Basic Skills Improvement Programs.'' All public school districts were 
required to submit this report to the Massachusetts Department of Education 
under Section 40.09 of the Regulations for Implementation of the Policy 
on Basic Skills Improvement. Required in this section was that districts 
annually report: 


''.,.the number and percentage of students by race, sex, 
and linguistic minority who have and have not achieved 
the minimum standards for each basic skill established 
by the public school district for the early elementary, 
later elementary, and secondary levels.''! 


These Regulations were promulgated by the State Board of Education on 
January 23, 1979, after the Board had adopted the Policy on Basic Skills 
Improvement on August 29, 1978. 


Under the Policy and Regulations, school districts were required to 
develop basic skills improvement program plans for the skills of reading, 
writing, and mathematics by August 1, 1980, for three grade levels - early 
elementary (K-3), later elementary (4-6), and secondary (7-12). At all 
grade levels, these program plans contained the following components: 


1) a description of how administrators, teachers, parents, 
employers, students (at the secondary level only), and 
the general public participated in the development of the 
plan; 


2) the basic skills objectives and level of achievement 
(minimum standards) for reading, writing, and mathematics; 


3) the instruments selected to evaluate student achievement of 
minimum standards; 


4) the grade level for evaluating students; 


5) a description of how the public will receive information 
on the plan; and 


6) a description of the follow-up instructional programs and 
services to be provided students not achieving minimum standards. 


School districts were required to start implementing these program plans 


during the 1980-81 school year. For the past two years, school 
districts reported (along with other data) the following information on their 
program results at each grade level and for each skil| (reading, writing, and 


mathematics): 


1. the grade level 


in which students were evaluated; 


2. the evaluation instrument (or instruments) which were 
administered; 


3. a description of the minimum standard used to determine 
if students had achieved basic skills; 


4. the number of students evaluated who achieved minimum standards; 


5. the number of students evaluated who did not achieve minimum standar 


6. the number of students exempted from the program or not 
evaluated during the school year. 


This information from school district reports is displayed in the nine 
computer printouts (one for each skill and grade level) which are found 
in this document. 


B. Description of Data Displayed in the Printouts of School District 


Report Data 


Sections I! through X of this document are comprised of copies of 
nine computer printouts containing data submitted by school districts in 
their 1981-82 Annual Report on Basic Skills Improvement Programs. 


The nine 


Section 


Section 


Section 


Section 


Section 


Section 


Section 


Section 


Section 


printouts are organized 


Early Elementary 
Early Elementary 
Early Elementary 
Later Elementary 
Later Elementary 
Later Elementary 
Secondary (7-12) 
Secondary (7-12) 


Secondary (7-12) 


in the following order: 
(K-3) Reading 

(K-3) Writing 

(K-3) Mathematics 

(4-6) Reading 

(4-6) Writing 

(4-6) Mathematics 
Reading 

Writing 


Mathematics 


Each printout displays the same type of information. The following data is 
provided for each school district (school districts are identified in the 
first two columns in each row of the printouts by a three digit code number 


followed by the name of the district): 


|. Grade - This number is the grade in which students were 
evaluated. For early elementary, this grade is reported 
On the printouts as either 1, 2, or 3. For later elementary, 
this grade is either 4, 5, or 6. For secondary, this grade 
is either 7, 8, or 9. 


2. Evaluation Instrument - The instrument used by school districts 

is reported on the printouts as a one or two digit code number. 
Before each printout, there is a table which states the 

name of each instrument associated with each code number. Some 
school districts administered more than one instrument for a 
particular grade level and skill. This situtation is not reported 
on the computer printouts because of column limitations in the 
data field. Districts which used more than one instrument at a 
particular grade level were contacted by the Department of Education 
and asked which of the instruments should be coded and reported 
on this printout. 


3. Minimum Standard - The minimum standard is the score on the 
evaluation instrument administered for a particular skill at a 
specific grade level that a student had to obtain in order to 
be reported as achieving standards. The minimum standard was 
reported by school districts differently for reading and mathe- 
matics than for writing. 


a. For reading and mathematics, the minimum standard was reported 
by school systems as either the percentage of test items 
students had to answer correctly or the number of test items 
students had to answer correctly of the total number of 
items on the test. All standards reported with the latter 
information were converted to a percentage correct. All 
minimum standards were thus coded and reported on the printouts 
as the percentage of items students had to answer correctly 
on the test. 


In some districts, it was not possible to convert the standard 

to a percentage correct. In these cases, the minimum standard 

was coded and is reported on the printouts as NK (not key- 
punched). For districts that administered more than one test 

for a particular grade level/skill, only the standard for the 

test reported in the evaluation instrument column was keypunched 
and reported. Finally, some districts established a minimum 
standard for different sections (e.g. subtests) of a test battery. 
Because of the column limitations in the data field, the minimum 
standards on each of the subtests could not be coded and reported. 
For districts that set standards on different subtests, the 
Standard was reported as the percentage of items a student had to 
answer correctly on the total test. 


b. For writing, school districts administered either an objective- 
item test and/or a writing sample(s). When districts admin- 
istered only an objective-item test, the writing standard was 
coded and is reported as the percentage of items on the test 
Students had to answer correctly. (This percentage is equivalent 
to the type of standard reported for reading and mathematics.) 


Districts which administered writing samples usually scored 
these samples using either the holistic or analytic methods. 
Most districts using the holistic method of scoring writing 
samples had two people rate each writing sample on a scale of 

1 to 4 (with 1 the lowest score assigned to a paper and 4 the 
highest score). The total score on a paper rated in this 
manner thus ranged from 2 to 8. When two writing samples were 
administered, the scores on both samples were either totaled 

so that the students' scores could range from 4 to 16 ( a scale 
of 2-8 on both samples) or the scores on both samples were 
averaged and reported on the 2-8 scale. Some districts used 

a variation of this holistic scoring method (e.g., rating on a 
5 point rather than a 4 point scale, using three raters rather 
than two raters). Standards established using holistic scoring were code 
and are reported as the minimum score students had to receive 
in order to be reported as achieving standards followed by a 
slash (/) and the total possible score students could 

receive. 


Districts using the analytic scoring method reported standards 
as numbers which were either comparable to an objective - test 
item score or a holistic score. These standards were coded 
and are reported on the printout on the basis of what school 
districts reported. 


lf districts administered both an objective-item test and a | 
writing sample(s) at a particular grade level, only the standard 
on the writing sample(s) was coded and reported on the printouts 
because of column limitations in the data field. 


In some cases the standards reported by school districts could not 
be converted into a percentage correct or holistic score. When 
this situation occurred the standard was coded and reported 

as NK (not keypunched). 


TSee Basic Skills Improvement Policy Implementation Guide #2 (Revised Edition): 
Writing Assessment Manual for a detailed discussion of these methods of scoring 
writing samples. 


Ww 


4. Students Evaluated - In these columns, the number and sercentage 
of students achieving and not achieving minimum standards as reoorced 
Dy scnool districts !s recorded on the orintouts. The ''TOTAL'' column 
in this section is the total number of students who were evaluated 
in the district for the particular grade level and skill. The 
percentage of students achieving and not achieving standards was 
calculated using this ''TOTAL'' figure as the denominator and the 


number of students acnieving standards and not achieving standards 
as the numerator. 


5. Students Exemoted/Not Evaluated - In these columns tne number 
of students reoorted Sy school districts as exempted/not evaluated 
is recorded on the printouts. The total number of students 
exempted/not evaluated is reported as wel! as the total numoder 
of students in each of the following three exemot/not evaluated 
categories - Special Education exemption, Limited Englisn 
Ability exemption, and Other. The total numoer of students 
evaluated and the total number of students exempted/not evaluated 
Nave to be added together in oraer to determine che total number 
of students reported by a school district for a sarticular grade 
levei and skill. ! 


In addition to the data ule for 2ach school district, state totals 
=or tne numper and sercentage of students achieving and not Sprbenning standards 
as well as state totais for the pieceet: of students exemoted/not sva!ueted 
appear in two olaces. Tnis data is displayed as she last line (AROTALS'}) 
on the orintouts tor 2ach grade level/skiil. In addition, thera are tnree 
soecia! arintouts on pages 32, 57, 79, with state totals for particular 
grade levels. 


- 


©. Cautions in Interoreting the Dats 
aS 


“any peopie who review the orintouts in this report will 2e interes 
in makina comoarisons among school districts. for axamele, aeop'e Tay es! 
draw conclusions 2s to which districts sad hich standarcs ee which district 
aad low standards or wnich districts Aad avian student cerformance on the sasic 
skills tests and wnich districts nad low student serformance. 3efore attemoting 
so nake any interdiscrict comparisons with tnese individual district results, 
-asgers should 3e cautioned regarding the iimitations of inis gata 2ase. nese 
limitations are discussed in this section. 


a3 
aA ia) 


= 


The reader snould first note that the Policy on 3asic skills !morovemenct, 
as acopted by the Massacnusetts State foard or Education, was not ee Eo) ae 
a venicle for collecting data that woule Se used to compare school districts. 


administered or students wno trans*er-ed into tne distri 
completed. 


The orimary ourzose of the Policy was ''to assist al! students in acnieving mastery 
Slease refer to Section 40.10 of the Regulations For imolementation of the Policy 
on Basic Skills !morovement for definitions of the Soecial Education and U:mitsd 
Enalisn Abilicy exemoction categceries. The ‘Other’ category included stucents wno 
were never evaluated during zine 1980-81 schoo! year because they were eosent wnen= 
ever Ene tests were - 

sti s 


Hace te cS 


ing wa 


of basic skills prior to high school graduation through the provision of 
appropriate curriculum, instruction, and evaluation''. | To help achieve 
this purpose, all public school districts in Massachusetts were required 
to establish minimum standards in the basic skills, to evaluate students 
to determine whether they have achieved these standards, and to report 
publicly on the results of their evaluation of students. The Policy, by 
design, encouraged local autonomy and flexibility in deciding what minimum 
Standards should be established and what evaluation instruments should be 
administered. !t should come as no surprise, then, that the printouts 
in this report indicate a high degree of variation in district standards 
and tests. 


The reason why the State Board of Education required school districts 
to report publicly on the results of their evaluations of student basic 
skills achievement was to promote a dialogue at the local level regarding 
overall student achievement in light of the minimum standards established 
by the individual community. The expectation was that, where appropriate, 
these results would be used for naragngs rng learning needs and adjusting the 
regular curriculum to meet these needs.'' The publication of individual 
school district results in this report may be viewed by some people as 
violating these basic principles of the Policy because these printouts 
make it much easier to make interdistrict comparisons than if the raw 
data from the reports had to be pulled from a file. The Department of 
Education,under freedom of information laws and reguiations, is required 
to provide this data to people who request it. Because of this situation, 
it was decided that the most efficient way to make individual school districts' 
basic skills results publicly available was through this publication. In 
addition to fulfilling legal obligations, this publication offered a vehicle 
for describing the background to the Policy, so that the data would hopeful ly 
be used and interpreted in their proper context. 


In addition to the policy framework just discussed, the following 
specific limitations in the individual school district results should be 
kept in mind when reviewing the data: 


1. Districts established different minimum standards, used 
different tests, and administered tests at different grade 
levels. 


2. Districts that apparently used the same test at the same grade 
level (as indicated by the evaluation instrument code numbers 
on the printouts) may in fact not have used identical tests. 


1 Basic Skills Improvement Policy and Regulation, p. 3 


2 Basic Skills Improvement Policy and Regulations, p.8 


Most major achievement test batteries, such as the 
California Achievement Test and lowa Test of Basic Skills, 
Nave numerous sections or subtests. The printouts don't 
indicate which subtest(s) within an achievement battery 
were administered by school districts. Readers should 
contact school districts to learn exactly which subtests 
were administered before comparing the performance and/or 
standards of districts that are using the same test 
batteries. 


3. Districts may have calculated the minimum standards in different 
ways. For example, in writing tests a score of 4/8 for one 
district may mean a score on one writing test whereas 4/8 in 
another district may indicate an average of two or more tests even 
though only one test could be reported because of limitations in 
the data field. Caution is necessary for interpreting this data 
in terms of interdistrict comparisons. 


4. Districts which administered the same test (such as the state 
secondary level reading tests) may not have administered the 
tests at the same grade leve!. District results are affected 
by the grade level and time of year the tests were administered. 
For example, seventh graders would not be expected to perform 
as well on a mathematics test as ninth graders. Even within 
the same grade, students tested in Seotember of the school 
year would not be expected to perform as well as students 
tested in Jume. Note that the printouts only indicate the 
grade the testswere administered, not the time of year within 
the grade. : 


5. The percentage of students wno were exempted/not evaluated 
differed from one district to another. District performance 
was also probably affected, to some extent, by the percentage 
of students who were exempted or not evaluated. 

6. If two or more districts administered identical tests, at the 
same grade level, at the same time of year, and with the same 
minimum standard, there are still reasons why comparing dis- 
trict performance should be carried out with extreme caution. 
There are many differences among school districts in 
Massachusetts which impact on student test performance. 
These differences include: community socioeconomic status, 
especially property wealth and parent educational! levels; 
per pupil expenditures; and school curricula and program 
offerings. 


One final cautionary note should be considered when reviewing this 
There are likely some discrepancies between the data reported by 


school districts on their Annual Reports and the data displayed in these 
Srintouts. If there are any discrepancies, they are a result of human error 
that will occur whenever such a massive amount of data is processed. 
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SECTION U1 


EARLY ELEMENTARY (K-3) READING 


EVALUATION INSTRUMENT CODE NUMBERS 


|NSTRUMENT 


Local Test 

lowa Test of Basic Skills, 1978-82 

Stanford Diagnostic, 1976 

Metropolitan Achievement Test, 1977-78 

Sequential Tests of Educational Progress,Circus, 1979 
Metropolitan Achievement Test, 1970-71 

California Achievement Test, 1977-78 

Comprehensive Test of Basic Skills, 1973-75 

SRA Achievement Series, 1978-79 

Test for Rolling Along (Scott Foresman), 1974 

SCORE (Houghton Mifflin), 1977 

Stanford Achievement Test, 1972-74 

SRA SOBAR Reading Mastery Test, 1975 

Gates-MacGinitie Reading Test, 1978 

Individual Criterion Reference Test (Educational Progress), 
1976-78 
Doren Diagnostic Test (Scott Foresman, Open Highways Test), 
ig73 

lowa Test of Basic Skills, 197] 

California Achievement Test, 1970 

Perscriptive Inventory (CTB McGraw Hill), 1980 
Keys to Reading (Economy Company), 1972 

Holt Basic Reading System Management Program, 1980 
Harcourt Brace Reading Test, 1974-75 

Basal Reading Series Test (Houghton Mifflin), 1971 
Criterion Referenced Tests: Wisconsin Design, 1977 
MacMillan Reading Test, 1970-75 

Comprehensive Test of Basic Skills, 1969 

Stanford Diagnostic, 1972 

Reading Placement Test 8 (Scott Foresman), 1976 
Educational Records 8ureau Comprehensive Testing(ETS), 1975 
Individual Pupil Monitoring System (Houghton Mifflin), 1978 
Orbit Criterion Reference Test (CTB/McGraw Hill), 1980-81 
Ginn 720, Criteria Exercises and Mastery Tests, 1976 
Stanford Achievement Test, 1978 

Perscriptive Reading Inventory (CTB/McGraw Hill), 19%-77 
Comprehensive Test of Basic Skills, 1981 

Ginn 720 Mastery Test, 1980 


Educational Records Bureau, Comprehensive Testing (ETS), 1982 
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SECTION Th 


EARLY ELEMENTARY (K-3) WRITING 


EVALUATION INSTRUMENT CODE NUMBERS 


EVALUATION INSTRUMENT 


Local Test 

Metropolitan Achievement Test, 19787/9 

lowa Test of Basic Skills, 1978-79 

lowa Test of Basic Skills, 197] 

California Achievement Test, 1977-78 

Stanford Achievement Test 1972-73 

SRA Achievement Series, 197 

California Achievement Test, 1970 

Comprehensive Test of Basic Skills, 1973-74 

Sequential Test of Educational Progress, 1979 

Story Card, Peabody Language Development Kit, !965 
Metropolitan Achievement Test, 197] 

Individual Pupil Monitoring System (Houghton-Mifflin), 1978 
Laidlaw Curriculum Cumulative Test, 1975 

SCORE (Houghton Mifflin), 1977 

State Test 

Comprehensive Test of Basic Skills, 198] 

Educational Records Bureau Comprehensive Testing (ETS), 1982 
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24. 
SECTION IV 


EARLY ELEMENTARY (K-3) MATHEMATICS 


EVALUATION INSTRUMENT CODE NUMBERS 


CODE {| NSTRUMENT 

01 Local Test 

02 lowa Test of Basic Skills, 1978-82 

03 Stanford Diagnostic, 1976-77 

04 Metropolitan Achievement Test, 1978 

05 Sequential Tests of Educational Progress, Circus, 1979 

06 Metropolitan Achievement Test, 1970-7] 

07 California Achievement Test, 1977-78 

08 Comprehensive Test of Basic Skills, 1973-75 

09 SRA Achievement Series, 1978-79 

10 SCORE (Houghton Mifflin), 1977 

1] Stanford Achievement Test, 1972-74 

2 SRA SOBAR Mathematics Mastery Test, 1975-76 

13 Individual Criterion Reference Test (Educational Progress), 
1977-78 

14 lowa Test of Basic Skills, 197] 

15 California Achievement Test. 1970 

16 MacMillan Mathematics Test, 1976 

17 Comprehensive Test of Basic Skills, 1969-70 

18 Individual Pupil Monitoring System (Houghton Biff lin)» lays 

19 Educational Records Bureau Comprehensive Testing (E1 975 

20 Holt Curriculum Cumulative Test, 1978 

21 Orbit Criterion Referenced Test (CTB/McGraw Hill), 1980-81 

22 Diagnostic Mathematics Inventory (CTB/McGraw Hill), 1975-78 

23 Stanford Achievement Test, 1978 

24 Mathematics Around Us (Scott Foresman), 1978 

25 Comprehensive Test of Basic Skills, 198] 


26 Educational Records Bureau Comprehensive Testing (ETS), 1982 
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SECTION V 


LATER ELEMENTARY (4-6) READING 
EVALUATION INSTRUMENT CODE NUMBERS 


EVALUATION INSTRUMENT 


Local Test 

lowa Test of Basic Skills, 1978-82 

Stanford Diagnostic, 1976 

Metropolitan Achievement Test, 1977-78 

Sequential Tests of Educational Progress, 1979 

Diagnostic Reading Tests(Economy Company), 1975 

California Achievement Test, 1977-78 

Comprehensive Test of Basic Skills, 1973-75 

SRA Achievement Series, 1978-79 

Open Highways, Seeking Adventure (Scott Foresman), 1974 
SCORE (Houghton Mifflin), 1977 

Stanford Achievement Test, 1972-74 

SRA SOBAR Reading Mastery Test, 1975 

Gates-MacGinitie Reading Test, 1978 

Individual Criterion Reference Test (Educational Progress), 
1976-78 

lowa Test of Basic Skills, 197] 

California Achievement Test, 1970 

Perscriptive Reading Inventory, (CTB/McGraw Hill), 1980 
Holt Basic Reading System Management Program, 1980 
Harcourt Brace Reading Test, 1974-75 

Basal Reading Series (Houghton Mifflin), 1971 

Criterion Referenced Tests: Wisconsin Design, 1977 
MacMillan Reading Test, 1970-75 

Metropolitan Achievement Test, 1970-71 

Comprehensive Test of Basic Skills, 1969 

Stanford Diagnostic, 1972 

Individual Pupil Monitoring System (Houghton Mifflin), 1978 
Orbit Criterion Referenced Test (CTB McGraw Hill), 1980 -81 
Ginn 720, Criterion Exercises and Mastery Tests, 1979-80 
Stanford Achievement Test, 1978 

Prescriptive Reading Inventory (CTB McGraw Hill), 1976-77 
Comprehensive Test of Basic Skills, 1981 

Educational Records Bureau Comprehensive Testing (ETS), 1982 
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SECTION VI 


LATER ELEMENTARY (4-6) WRITING 


EVALUATION INSTRUMENT CODE NUMBERS 


EVALUATION INSTRUMENT 


Local Test 

Metropolitan Achievement Test, 1978 

lowa Test of Basic Skills, 1971 

lowa Test of Basic Skills, 1978-80 
California Achievement Test, 1977-78 
Stanford Achievement Test, 1972-73 

SRA Achievement Series, 1978-79 

California Achievement Test, 1970 
Comprehensive Test of Basic Skills, 1973-74 
Sequential Test of Educational Progress, 1979 
Metropolitan Achievement Test, 1970 

Laidlaw Curriculum Cumulative Test, 1975 
State Test 

Comprehensive Test of Basic Skills, 198] 


Educational Records Bureau Comprehensive Testing (ETS), 1982 
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49. 
SECTION VII 


LATER ELEMENTARY (4-6) MATHEMATICS 


EVALUATION INSTRUMENT CODE NUMBERS 


INSTRUMENT 


Local Test 

lowa Test of Basic Skills, 1978-82 

Stanford Diagnostic, 1976 

Metropolitan Achievement Test, 1978 

Sequential Tests of Educational Progress, 19/79 

Metropolitan Achievement Test, 1970-7] 

California Achievement Test, 1977-78 

Comprehensive Test of Basic Skills, 1973-75 

SRA Achievement Series, 1978-79 

SCORE (Houghton-Mifflin), 1977 

Stanford Achievement Test, 1972-74 

SRA SOBAR Mathematics Mastery Test, 1975 

Individual Criterion Reference Test (Educational Progress), 
1977-78 

lowa Test of Basic Skills, 197] 

California Achievement Test, 1970 

MacMillan Mathematics Test, 1976 

Comprehensive Test of Basic Skills, 1969 

Individual Pupil Monitoring System (Houghton-Mifflin), 1978 
Holt Curriculum Cumulative Test, 1978 

Orbit Criterion Referenced Test (CTB/McGraw Hil!) 1980-81 
Diagnostic Mathematics Inventory (CTB/McGraw Hill), 1975-78 
Stanford Achievement Test, 1978 

Mathematics Around Us (Scott Foresman), 1978 

Comprehensive Test of Basic Skills, 1981 


Educational Records Bureau Comprehensive Testing, (ETS), 1982 
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SECTION VIII 


SECONDARY (7-12) READING 


EVALUATION !NSTRUMENT CODE NUMBERS 


| NSTRUMENT 


Local Test 

State Test, Form 2 
State Test, Form 3 
State Test, Form 4 


Basic Skills Assessment (Addison-Wesley/ETS), 1977 


State Test, Form 2 and 3 
State Test, Form 


’ 
State Test, Forin 1 and 2 
State Test. Form | and 3 
State Test, Form | and 4 
State Test, Form 2 and 4 
State Test, Form 3 and 4 


California Achievement Test, 1977-78 
Comprehensive Test of Basic Skills, 1973-75 
Comprehensive Testing Program, 1980-82 

lowa Test of Basic Skills, 1978 

Metropolitan Achievement Test, 1978-79 

Senior High Performance of Reading Performance, 
Sequential Tests of Educational Progress, 1979 
SRA Achievement Series, 1978 

Stanford Achievement Test, 1972-73 

Stanford Diagnostic, 1976 

Test of Achievement and Proficiency, 1978 
State Test, Form 2, 3, and 4 

State Test, Form |, 2, 3, and 4 

State Test, Form 5 

State Test, Form 6 

State Test, Forms 5 and 6 

State Test, Forms 2, 4 and 5 

lowa Test of Basic Skills, 198] 

Comprehensive Test of Basic Skills, 198] 
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SECTION IX 


SECONDARY (7-12) WRITING 


EVALUATION INSTRUMENT CODE NUMBERS 


INSTRUMENT 

Local Test 

State Test, Form 

State Test, Form 

State Test, Form 

State 

State Test, Form 

State Test, Form and 


Test, Form 
Test, Form 
Test, Form 
Test, Form 
Test, Form 2, 3, and 4 

Skills Assessment (Addison-Wesley/ETS), 1977 
Test,’ Form: 1;-2Z, 3; and 4 
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Test, Form 2 and 3 
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A Writer's Skill (E€TS) 
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Test, Form 5 

Test, Form 6 

Test, Form 5 and 6 
Test, Form 4 and 6 
Test, Form 2, 3 and 5 
Test, Form & and 5 
Test, Form 3 and 5 
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